SUMS OF BINOMIAL DETERMINANTS, NON-INTERSECTING LATTICE PATHS 
AND POSITIVITY OF CHERN-SCHWARTZ-MACPHERSON CLASSES 



LEONARDO CONSTANTIN MIHALCEA 

Abstract. We give a combinatorial interpretation of a certain positivity conjecture of Chern-Schwartz- 
MacPherson classes, as stated by P. Aluffi and the author in a previous paper. It translates into a pos- 
itivity property for a sum of p x p determinants consisting of binomial coefficients, generalizing the 
classical Theorem of Lindstrom-Gessel-Viennot et al. which computes these determinants in terms of 
non-intersecting lattice paths. We prove this conjecture for p = 2, 3. 



1. Introduction 

To any 2p lattice points Ai , • • • , Ap and Bi , • • • , Bp in one can associate a p x p matrix of 
binomial coefficients M = (mij), where raij is equal to the number of lattice paths from At to 
Bj, with each segment oriented either North-South, or West - East (see Figure 1 below). It is a 
classical result about binomial determinants (see e.g. 10 IGVII or see IK| and references therein) 
that if the points A| respectively B^ are arranged, in order, from North-East to South- West, then 
the determinant of M is non-negative, and counts p— tuples of non-intersecting lattice paths tt = 
(ttt , • • • , TTp), where 7T| is a path from A| to B|. In this note we conjecture a generalization of this 
result, where the conditions on the initial lattice points A| are relaxed (but Bj's are still in the 
same NE-SW configuration). It is common for a fixed set of At's in the relaxed hypothesis to yield 
a negative determinant, but when the sum of all the allowable configurations is considered, the 
result will be positive. The precise statement is given in Theorem 12.11 below. In this note we prove 
this conjecture for p =2,3. 

Besides the intrinsic combinatorial interest, this conjecture has geometric significance: the sum 
of the determinants we consider is the coefficient of the fundamental class of a Schubert variety in 
the Grassmannian Or (p,n) of p— planes in C"^, for n large enough, in the expansion of a Chern- 
Schwartz-MacPherson (CSM) class of a Schubert cell. In this geometric setting, the conjecture 
appeared in a previous paper by P. Aluffi and the author ([AMJ). For further details, we refer 
the reader to loc. cit.; the precise connection with the determinants considered herein is given in 
Remark l2.2l below. 



2. Statement of results 

2.1. Definitions and notations. In this note a path n will be a lattice path in I?- with the horizontal 
steps to the right and the vertical steps going down. For A, B G the notation 7t : A — > B means 
that 7T starts at A and ends at B. See the Figure 1 below. 

By a partition A we mean a decreasing sequence of nonnegative integers 

A = (Ai ^A2^---^Ap^0). 

Let A = (Al , • • • , Ap) and |j, = ( , • • • , |Xp) be two such partitions. To this data we associate a family 
of 2p points Al (s), • • • , Ap(s) and Bi , • • • Bp in l/. The points At(s) will depend on a sequence of 
parameters s in a set S which we define in the next paragraph. The points Bj, for 1 ^ j ^ p are 
defined simply by: 

Bj :=(^j+p-j + l,^j+p-j + l). 
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(1.5) 



(6,1) 



Figure 1. A path from (1,5) to (6, 1). 

The set S consists of sequences s = ( at j ) of nonnegative integers indexeci as the elements of a 
square matrix of orcder p — 1 , situated on or below the main diagonal: 



(2.1) 



12,1 



0-2,2 



Definition 2.1. Let A = (Ai , • • • , Ap) be a partition. We say that the integers aij are in triangular order 
with respect to A if: 

(1) 0^ ^ Aj+1. 

(2) The partial sums from the ] — th column, from row j + 1 fo i + ],for all] ^ i ^ p — 1 — j, are less 
than Ujj, i.e. 

(2-2) Uj+ij + ... + aj+ij ^ ajj. 

To simplify the notations in the upcoming formulae, we let Rj, for 2 ^ j ^ p — 1, respectively 
Cj, for 1 ^ j ^ p — 2 denote the partial sum on the j— th row, respectively j— th column of 12. 1[ 
excluding aj j: 



R 



1 ■— 



aj 1 + ... + aij_i. 



(2.3) 

(2.4) q := aj+ij + ... + Up-ij. 

Set also Ri = Cp_i = 0. Denote the set of all triangular sequences with respect to A by S(A) and an 
element of it by s = (uij ). We define the lattice points Aj (s) by 

Aj(s) := (p - j + 1 + ajj - Rj, Aj + p - i + 1 - Rj) 

for 1 ^ j ^ p — 1 . If j = p, let the x— coordinate of Ap(s) be 

^Apis) := 1 + (Ci - aij) + (C2- a2,2) + ••• + (Cp_i - ap_i,p_i) 

and the y— coordinate to be 

^Apls) ■= ^P +^Ap(s)- 

For s € S define the matrix M(s) = (ratj(s)) by 

my(s) =#P(A,(s) ^Bj), 
where the right hand side denotes the number of paths from Ai(s) to Bj. Let 

c(A, ix) = Y_ detM(s). 

S6S(A) 
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2.2. Main result/conjecture. 

Theorem 2.1 (Positivity for p ^ 3 and general conjecture). The coefficient c(A, |x) is positive ifj) ^ 3 
and we conjecture it to be positive for all p. 

Remark 2.1. In the cases p = 2 respectively p = 3, positive combinatorial formulae for c(A, \i) are 
given respectively in Corollaries 13.51 and IS.lOl below. 

Remark 2.2. Choose n large enough so that Ai , |Xi ^ n — p. Denoting by respectively S^^ the 
Schubert cell respectively the Schubert variety corresponding respectively to partitions A and |x 
(see IIAMII for details), c(A, |x) is the coefficient of the CSM class of §^ in the homology Schubert 
class [S|J. In the notation from flAM| , c(A, p.) = ■yA,^• 



Remark 2.3 (Explicit definition of M(s)). Given the triangular sequence s 
is equal to: 



(2.5) M(s) 



( 



Vl+Rl -11,1'' 



A2— a2,2 

m +l+R2-a2,2'' 



Ai-ai,i ^ 
-<il ,1/ 



^H2-l+Ri 

( A2-a2,2 
^2+^2-12,2 



= (aij), the matrix M(s] 

f Al -Ql J \ \ 

^^p-(p-l)+Ri-Ql,l.' \ 

f A2-a2,2 \ 

^Hp-(p-2)+R2-Q2,2/ 



f Ap_l — Qp-i ,p_i ^ 

^M-l +p-2+Rp_i -Qp_i ,p_i/ 



1— Qp-I.p-I \ 
?p-l — ip-l ,p-1' 



^|ip-l+Rp 



' Ap_i — ap_i ,p_i \ 
^ V-2 +p-3+Rp^ 1 -ap - 1 ,p - 1 / 

\ ( m +P-1 r= 1 ( as , s -Cs )) ( ^i2 +P-2+L IZ] ( as , s -Q )) 
i.e. the binomial coefficient on the row r and column c, for 1 ^ r ^ p — 1 is equal to 

At- — Ur^r 
^|J,c + T — C + Rr — ar,Ty 

For example, in the case p = 2, the triangular sequence S(A) consists of all (an) such that ^ 
an ^ A2 and M(an) is givenby: 



(2.6) 



rAi-ai iN / Ai-aij \" 
^W-ai 1/ ^^2-^-a, 1/ 



A2 

+l+a, J ' 



A2 

^ ^2 +ai , 1 1 



Similarly, in the case p = 3, the triangular sequences consist of triples ( a2i , a22, in ) ^ such that 



and M(s) is: 



(2.7) 



^ a2i ^ an; ^ a22 ^ A3; ^ an A2, 

-ai,i"\ / Ai-ai,i \ 

-ai,i/ Vn2— 1— ail/ 



^Ai -ai ,1 

A2— a2,2 \ 
—0.2.2' 



+1+a2,i — a2,2 
A3 

f2+(a, -a2,i 



a2,2 



) ( 



/ A2-a2,2 \ 

V2+a2,i -a2,2/ 

A3 ] 
l^2+l+(ai ,1 -a2,i )+a2,2'' 



/ Ai-aij \ 
V3-2-ai,,/ 

( A2-a2,2 

\^3-1+a2,i — a2,2'' 
A3 

^3+(a^ ,1 -a2,i )+a2,2^ 



Remark 2.4. The positivity conjecture for c(A, |x) was checked on the computer for all pairs A, \x 
included in the partitions 7^ = (7, 7, 7, 7, 7), 5^ = (5,5,5,5,5,5), 10^ = (10,10,10,10) etc. 

2.3. An example for p = 3. Let A = (3, 3, 3) and ]x = (2,2,1). To avoid carrying subscripts in the 
case p = 3, we identify the triangular sequence ( a2i , a22) ii 1 ) to (i, j , k), so that 

^ k ^ A2; ^ i k; ^ j ^ A3 . 

The lattice points A^, B^, for A^ = Ac(l, j, k), 1 ^ £ < 3 are given by 

Ai = (k + 3,Ai +3); A2 = (2 - i + j, A2 + 2 - i); A3 := (1 - k + i - j, A3 + 1 - k + i - j), 

Bi = (5,5),B2 = (4,4),B3 = (2,2) . 



^We used the ordering (a2i , a22 , Qi 1 ) rather than (ai 1 , ai2, C122) to be consistent with the notation (021 , Q22, Qi 1 ) 
(i, j , k) used throughout the paper starting from the next paragraph. 



4 



LEONARDO CONSTANTIN MIHALCEA 



Using the the version of Lindstrom-Gessel-Viennot from l|GV| . Thm. 1, it follows that each of 
the determinants of matrices M(i, j,k) counts signed triples of non-intersecting lattice paths. We 
are forced to include signs since a non-intersecting triple may also arise from a permutation w € 
Syra(3) of the initial points. In this case a triple = (tti , nj, 713) where 7tf : A^j^j — > has to be 
counted with the sign £(w) = (—1 where l(w) is the length of w. The content of the Theorem 
12. II is that all triples counted negatively are cancelled by the positive ones. 
In fact, we will prove more: if the sum j + k is fixed, say j -|- k = f then 

(2.8) c(A,^;f):= Y. M[i,j,k) 

(i,j,k)GS(A),j+k=f 

is non-negative and there exists an f such that this sum is positive. As an example, let j -|- k = 2 
(so f = 2). The configurations arising from this situation are those from Figure 2 below. Then 
c( (3, 3, 3) , (2, 2, 1 ); 2) is the sum of 6 determinants, and it can be written as: 

c((3,3,3),(2,2,l);2) = + 3 + 6 + 3 + 3-3 = 12 . 
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Figure 2. Configurations of A's and B's for A = (3,3,3), = 
(2,2,1) and j + k = 2; figures correspond, left-right, top-down to 
(0,2,0), (0,1,1), (1,1,1), (0,0, 2), (1,0, 2), (2,0, 2). The blue dots represent the 
points Bf, which do not vary with (i, j, k). 

Note, for example, that det M(0,2,0) =1—1 = since there is one triple of non-intersecting 
paths, (Ai,A2,A3) -t (Bi,B2,B3) counted with +1, and one triple (A2,Ai,A3) -> (Bi,B2,B3) 
counted negatively. This is different from the case (T.,j,k) = (2,0,2) when all the triples are 
counted negatively (in fact, this is just an ordinary Gessel-Viennot determinant, with the second 
and the third row swapped). 

2.4. Idea of proof. To show that the coefficient c((Ai , A2, A3), (m , |X2, M^3);f) is nonnegative it is 
enough to prove that there is an injective map from the non-intersecting triples which count neg- 
atively to those counting positively. We show how this map is constructed for the negative paths 
computing det M(0, 2, 0) and det M(2, 0, 2) in Figure 2 above. To shorten notations, we denote by 
V[[A^ , A2, A3) — ) (Bi , B2, B3)) the set of non-intersecting triples of lattice paths n = [n^, nz, n^) 
where tt^ : A^ — > B^. 

The map will distinguish between two cases: one when w is the transposition (12) and one 
when w = (23); (i, i,k) = (0,2,0) corresponds to the first case, while (2,0,2) to the second. We 
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will show among other things, in ^3.6[ that these are the only configurations resulting in (non- 
intersecting) triples counted negatively. 
If (I, j , k) = (0,2,0), from a triple of paths 

(7ri,7r2,7t3] G P((A2,Ai,A3) (81,82,83)), 

we construct a triple 

{n],nl,nl] G P((At,A5,A5) (81,82,83)) 
where (Ai,A2,A3) is the triple corresponding to (i*,j*,k*) = (0,1,1); the path remains un- 
changed, so = 7t3. As for 7t^ respectively 7T2, they are constructed using certain 'surgery' on n-\ 
and 7t2 respectively. This process, described below, is shown in Figure 3. First, one translates the 
source A2 of n-\ horizontally to left, say x units, until it hits nj. Let A2 be this intersection point 
and define to be the portion of starting at A2. Similarly, given the x units from the previous 
step, one translates the portion of 7t2 from Ai to A2 horizontally to the right x units, and form the 
new path Note that in this case, the triple (i*, )*, k*) corresponding to (Ai , A2, A3) is obtained 
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Figure 3. Construction of paths n] and corresponding to the inversion (12) 
from the initial (i, j , k) by making 

(2.9) i* := i, ]*:=)- X, k* := k + X, 

and such a transformation leaves S (A) and the sum j -|-k invariant, provided that x is small enough. 

A similar procedure, using now a diagonal translation with slope 1 , can be used to construct a 
positive triple out of one corresponding to the inversion (23). This is illustrated in Figure 4. In this 
case, the newly obtained triple (A5[, A2, A3) is via the transformation 

(2.10) i* :=i-x, j* := j, k* := k , 
which again preserves S(A) and the sum j -I- k for small x. 

Acknowledgments. I am grateful to Paolo Aluffi for some inspiring conversations and to Christian 
Krattenthaler for his valuable suggestions and pointing out useful references in the area. Most 
of this work was done while enjoying the hospitality and support of Max-Planck Institute fiir 
Mathematik, Bonn. 

3. Proof of the main result 

3.1. Preliminaries on non-intersecting lattice paths. We use the notations from ^2.11 We fix two 
partitions A = (Ai , • • • , Ap) and |j. = (m , • • • , |Xp). The following is the connection between the geo- 
metric determinantal formulae for CSM classes from Theorem 3.4 in [AM] and the determinants 
considered in this paper. Recall that the determinant M(s) was defined in equation (|2.5|) . 
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Figure 4. Construction of paths tIj and 7T3 corresponding to the inversion (23) 

Proposition 3.1. Let s G S(A) be a triangular sequence and let A£(s), be the associated lattice points. 
Then 

Proof. This is a straightforward computation, taking into account that the number of paths be- 
tween the lattice points A = (ai , ai) and B = (b, b), such that A is NW of B is {"^^a^^ ) . □ 

We recall next the (unweighted) version of the classical theorem of Lindstrom-Gessel-Viennot 
which allows any configuration of the initial points and end points. Recall that 7'(E — > F) denotes 
the set of lattice paths from E to F. 

Theorem 3.2 (Thm. 1 in [GVJ). Let E^, Fj be 2p lattice points, with 1 ^ i, j ^ p. Then the determinant 
det(#7'(Ei — ) ¥j)-\^i^j<^p is equal to^^^ £.{w), where wis a permutation in Syvn[Tp), £(w) is its signature 
and the sum is over all Tp— tuples of paths 

Ttw = (Tti , ...,7tp ) 

with tC^ : E-^v(i) — > F| , such that no two paths and intersect. 

3.2. Possible configurations for the points A£(s) and B^. Since the parts of the partition [i are 
decreasing it follows that for l-\ > l^, the point Bf, is strictly North-East of Bf^ (see figure below). 
The points A^ = A£(s), for a fixed triangular sequence s, are not arranged as nicely. ITowever, the 
following holds: 

Lemma 3.3. (a) Let s be a triangular sequence. Then A-\ (s) is strictly North and strictly East of Ap{s), 

i.e. Xa, (s) > (s) and y^i (s) > y Ap (s)- 

(b) A^{s) is strictly North of Alls), for all 2 ^ £ ^p-1. 

Proof. This is a straightforward computation. □ 

3.3. Two distance functions between paths. Let tt and tt' be respectively two paths between A 
and B, and A' and B'. We define two distances between n and n'. One is a horizontal distance, 
denoted DhItt, tt') and the other is a diagonal distance, denoted Dd(7t, n'). These distances will be 
the quantities x used to define the transformations described in equations (|2.9|l and l|2.10|) . 

We define Dh first. This distance will only be defined provided that yA > Va'> i-e. that A' is 
strictly to the South of A. The reader can refer to Figure 3, with (A, B) = (Ai , B2) and (A', B') = 
(A2,Bi). Assume that a horizontal line L' passing through A' intersects tt in a point C. Then 
Dh[n,n') = I where I is the length of the segment A'C. If L' doesn't intersect n then we set 
Dh[n,n') = 00. In Figure 3, Dh = 1. 
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Figure 5. The end points Bj. 

To define D^j, we take diagonal lines L and L' of slope 1 starting respectively from A and A' in 
both directions (in Figure 4, (A, B) = (A3, B2), (A', B'] = (A2, B 3), and the lines L and L' happen to 
coincide). If at least one of L or L' intersects respectively 7t' and tt (say in C or C), then ^[n^ 7t') 
is the (diagonal) length of the segment AC' or A'C (necessarily just one) formed in this way. 
If neither of L and L' intersects the associated paths, define 0^1(71, 7t') = 00. The following is 
immediate: 

Lemma 3.4. Assume that 7tr : Ar — > Br, 1 ^ t ^ 2 are two paths, and that Bi and B2 are on the main 
diagonal. Then Dci(7t, 7t') < 00. 

3.4. Two swaps. Let tti : Ai — > B2 and 7t2 : A2 — > Bi be two paths as in Figure 3. We will define 
two 'swaps' between tti and 7T2; one horizontal and one diagonal provided that the corresponding 
distance between the paths is not infinity. The result will be a new pair of paths, (tt^ , 712) and new 
sets of points A*, r = 1 , 2. The end points B^ remain fixed. 

In fact, we only define the horizontal swap as in Figure 3 above and we let the reader to fill in the 
details for the diagonal swap, using the Figure 4. Let Ar = (xa^ ,y/^^),r = ],2. 

Assume that Dh(n-i , 712) = I and that this distance is realized by the segment A2A2, with A2 G 
7ti . Then let 7T2 to be the partial path obtained from n-\ by chopping off the part from Ai to A2. To 
define 7t^ we translate horizontally the path from Ai to A2 and attach it to 712 such that A2 becomes 
A2. Then A5[ will be the new starting point of 7ty In terms of coordinates, if (xr,yr) arid (Xr,yr) 
are the coordinates respectively of Ar and A*, then 

M,yi) = (xi ±l,yi) and (x2,y2) = (xiTl.yi) 
where ± is decided by the orientation of the segment A2A2: plus if xa* < 'X-Az > minus otherwise. 
Similarly, if Dd(7ti ,712) = I' then (Xr.y*) = (xr ± l',yr ± I'). 

3.5. Positivity for p = 2. Recall that in the case p = 2 a triangular sequence s has just one element, 
denote it i, satisfying ^ i ^ A2. Then the situation is very simple: for any i, the lattice points 

(i), A2(i), Bi , B2 satisfy the hypothesis of the Gessel-Viennot Theorem, i.e. Ai (i) is North-East 
of A2(t.) for all i. Therefore the intermediate determinants from equation ( 12.61 1 are non-negative. 
To state the precise formula, let n(i) denote the set of all non-intersecting pairs of paths [n\ , 712], 
with 7tr : Ar(i) — > Br. 

Corollary 3.5 (Positivity for p = 2). Let A = (Ai , A2) he a partition. Then for any partition (j., the 
coefficient c(A, |x) is equal to 

A2 

i=0 
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3.6. Positivity for p = 3. To shorten notations, let, as before, [az:, azi, = (i-, The con- 
straints for the triangular sequence with respect to A translate to: 

(3.1) ^ k ^ A2; s: i < k; ^ j ^ A3. 
Fix such a sequence (i, j, k); recall that 

Ai = (k + 3,Ai +3); A2 = (2 - i + j, A2 + 2 - i]; A3 := (1 - k + i - j, A3 + 1 - k + i - j). 

Fix also a partition |j, = ^ M-i ^ M-a) which determines Bi , B2, B3: 

Bi-:= (^r + 3-r+l,^i- + 3-r + l), 1 ^ r ^ 3. 

Invoking again the classical Gessel-Viennot theorem, if Ai , A2, A3 are arranged, in order, (weakly) 
from NE to SW, the corresponding determinant will be nonnegative. Since Ai is always strictly 
NE of A3, and strictly North of A2 (by Lemma I3.3|) it follows that there are only two possibilities 
which may yield a negative determinant: 

Case 1. A2 is strictly S and strictly E of At and there is a triple ofnonintersecting paths n= (ttt , 7t2, 713) 
such that 7Ti : Ai — > B2, 7T2 : A2 — > Bi and 7T3 : A3 — > B3 (see e.g. the configuration corresponding to 
(i, j , k) = (0, 2, 0) in Figure 2). In this case, let I := Dh(7Ti , 712) be the horizontal distance between 
7Ti and 7t2. Clearly I < 00. Then perform the horizontal swap to (711,712) to define [7t\,7t^), with 
7T* : A* — > Bt-. The new starting points A^ and A2 are given by the sequence (i*, j*, k*) where 

(3.2) i*=i; j* = j - 1; k*=k + l. 

Note that 713 is not affected; denote by n* = {7t\,n2, 713) the new obtained triple. We have to show 
that (i*, j*,k*) satisfy the constraints conditions in 13.11 Indeed, the relative position of the paths 
7ti and 712 implies that — 1 ^ 'X-a-, , i-e. that 

2 + i- j -I ^ k + 3. 

In particular 

) — l^k+1 — i>0 and k + l^i — j — 1 <A2. 

Another important feature of the swaps performed is that the paths in the new triple 7r* are non- 
intersecting. This follows immediately from their construction: A3 is SW of Ai and n\ is obtained 
by moving the 'head' of Tti, containing Ai, horizontally to the right. 

Case 2. A2 is not weakly North and weakly East of At, and there is a triple of nonintersecting paths 
7t = (7ri , 712, Tts) such that 7i-\ : A-\ — > Bi, 7t2 : A2 — > B3 and 7:3 : A3 — > B2. There are three situations, 
according to A2 being NW, SE or SW of A3 (see subcases 2.1, 2.2 and 2.3 below). In all three 
situations one performs a diagonal swap to (712, 71$). We obtain a new triple 7X* = (7ti , 7t2, 713), with 
7T* : A* — > Br and the new sequence (i* , j* , k* ) defining A* (r = 2, 3) is given by: 

(3.3) i*=i-l; j* = j; k* = k. 

As in Case 1, we have to show that (i*, j*, k*) satisfies the constraints 13. 1[ i.e. that i ^ I. 
Subcase 2.1. A2 is NW of As, i.e. xa2 < and y A2 ^ y A3 ■ In this case 

1 ^ XA3 — XA2 = (1 — k + \ — ])~(2 — i + ]) =21 — k — j-1 

which shows that 

l-l^k-l-Fj-Fl >0. 
Subcase 2.2. A2 is SE of At,, i.e. xa2 ^ ^As and ■yA2 < VAs- In this case 

l^yA3 - yA2 = (1 + A3-l< + ^-1)-(2 + A2-l) = (A3-A2)+21-k-j-l 
which shows that 

1 - 1 ^ (A2 - A3) k - 1 j -M > 0. 
Subcase 2.3. A2 is SWofAs, i.e. xa2 ^ 'x-At, and yA2 ^ VA3, but A2 / A3. In this case 

1 ^ max{xA3 - XA2 , y A3 - y A2I 
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and the computation reduces to one from Subcases 2.1 or 2.2 above. 

We also need to show that the diagonal swap produces a non-intersecting triple of paths. This 
is done separately for each of the subcases above, and it should be clear from the construction. 

To finally show positivity, let c(A, \i; f ) be the partial sum from equation (|2.8|) defining the coef- 
ficients of CSM classes in the case p = 3, obtained by fixing k -I- j = f . 

Theorem 3.6. Let ^ f ^ A2 + A3. Then the partial sum c(A, |j,;f) is nonnegative and c(A, 0) > if 
|x C A (i.e. ]Xr ^ Ar, /or 1 ^ r ^ 3). 

Proof. The second part of the Theorem is immediate: if f = 0, then (i, j,k) = (0,0,0), and 
the points Ai , A2, A3 are arranged from NW to SE, thus satisfying the hypothesis of the Gessel- 
Viennot Theorem. Since C A, each is SE of A^, so there is at least one non-intersecting triple of 
paths 7t : (Ai , A2, A3) — > (Bi , B2, B3). To prove the first part it is enough to show that there cannot 
be triples tt = (tti , 7T2, 7T3) and tt** = (tt^* , n*2* , tt" ) such that: 

(1) 7t and TT** are triples of nonintersecting paths. 

(2) 7t creates a (12) inversion, as in Case 1 above, i.e. n-\ : A-\ (i,i,lc) — > B2, tx.2 : A2(i,i,Tc) — > Bi, 
7t3 : A3(i,j,k) ^ B3. 

(3) 7t** creates a (23) inversion, as in Case 2 above, i.e. n]* : Ai(i**,j**,k**) — ) Bi, tIj* : 
A2(i**,j**,k**) ^ B3,7t** : A3(i**,i**,k**) ^ B2. 

(4) The new triples obtained by applying a horizontal swap to (n-\ ,712) in tt and a diagonal 
swap to [7X*2* , 7t3* ) in tt** are equal. 

We assume there are such triples, and recall that i,i,k is the sequence corresponding to n; to 
shorten notation, let Ai , A2, A3 be the starting points of the paths determined by n and let A^ , A2 
be the initial points of the paths 7t^ : A^ — > Bi and : A2 — > B2 obtained from the horizontal 
swap of (7ti,7T2). Let also li = 0^(711,712), I2 = Dd(7t2>'^3) ^^'^ i^*,)*,^*) be the sequence 
determining A^ , A2 and A3 = A3. Refer to Figure 3 for the configuration of Ai , A2, A3. The next 
lemma shows the relations between i, i*, i** and so on, needed later. 

Lemma 3.7. (a) i* =i and i** = i -I- 12. 

(b) k* = k + li and k** = k*. 

(c) j* = j — li and j** = j*. 

Proof. This follows from the equations 13.21 and 13.31 which record the transformations of i, j, k after 
a horizontal or diagonal swap. □ 

Since n creates an (12) inversion, it must be that A2 is strictly S and strictly E of Ai, i.e. 

(3.4) XA2 > xai and < Ua, 

(use Lemma |331 and the fact that if XA2 ^ xa, then 7ri and 7t2 must intersect). Moreover, by the 
definition of li, 

XA2-XA, >li ^ (2-i + 3)-(k + 3) >k+L 

In particular, 

(3.5) j - i ^ li + 1 . 

Lemma 3.8. A3 is strictly S and strictly W of K\, i.e. xa| > xaj ci'nd y aj > U A3 ■ 
Proof. We have 

yA*-yA3 =(A2-A3) + (k-i) + (j-i) + l >2>0, 
where follows from A2 ^ A3, k ^ i and equation (|3.5|) . As for xa* > XA3 this happens since 
^A* ^ ^A, > XA3/ the first inequality holds because performing a horizontal swap to paths 7ri , 7t2 
creating a (12) inversion implies A2 € 7ri, therefore A2 is weakly East of Ai; for the second in- 
equality use Lemma |331 □ 
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This lemma, together with the definition of I2, implies that 

I2 ^ min{xA* - ,yA* - VAi)- 
The triple [i** , j** , k** ) must satisfy the constraints (|3.1|) , so in particular 

r* ^ k** ^ i + I2 < k + li . 

Then the theorem follows from the following lemma, which contradicts the existence of such a 
triple, and therefore of tt** . 

Lemma 3.9. i + minlxAj - xaj , y a* - y A3 1 > 1^ + l-i • 

Proof. We first show that i + VA* —Va^ >k + li. This is equivalent to 

i + (A2 - A3) + k - i + 1 + i - i > k + li ^ (A2 - A3) + 1 + j - i - li > 

and the last expression is true by equation (|3.5|) above. Similarly, taking into account that xa* = 
2 — i + j — li , we have 

T- + xaj - XA3 > k + li <4 1 + j - li + j - 1. - li > 

which is true again by the equation ( I3.5D above. This finishes the proof of the lemma and of the 
theorem. □ 

The proof of the Theorem suggests a positive formula to compute c(A, |x): for a fixed triple 
(i, j, k), the triples of paths 7t = (tti , nz, n^) which contribute to c(A, |x) must satisfy the following: 
(PI) 7t corresponds to identity permutation, i.e. 7tr : Ar — > Br, for 1 ^ r ^ 3. 

(P2) Let Ih be the horizontal distance between n-\ and 712 and let be the diagonal distance be- 
tween 7T2 and 7t3. Then either 1^ = 00, or, if 1^ < 00, neither of triples 

+ In.k- Ih) or (i + la,i,k) 

is triangular, i.e. neither of them satisfies the conditions from (|3.H) . For the first triple, this can 
happen, for example, if j + Ih > A3 or if k < Ih. 

We call the triples n = (n-\ ,712,713) satisfying (PI) and (P2) balanced. The properties (PI) and 
(P2) mean that one cannot perform a horizontal transformation to n-\ and nz, or a diagonal trans- 
formation to 712 and 713, arid obtain a triple of paths with initial points Ai , A2, A3 coming from a 
triangular sequence in S(A). Informally, 7t2 is 'far enough' from either n-\ and n$, so one cannot do 
either transformation. In sum: 

Corollary 3.10. c(A, |x) is equal to 

Y_ #^bal((Ai(s),A2(s),A3(s)) ^ (Bi,B2,B3)) 

seS(A) 

where Vbai indicates that only the balanced triples from P((Ai(s),A2(s), A3(s)) — > (Bi,B2,B3)) are 
considered. 
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